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12 January 1981 


MEMORANDUM FOR: a 


VIA: 
FROM: 
SUBJECT: Notes on Proposal for Systems Acquisition Study 
1. KasecleO is obviously going to be a very informal memo. You had 
indicated that the systems acquisition study may well be done and that you 


might end up doing it and had requested that I put together whatever 
information was available so as to make it as easy as possible to pick up on it 
where I left off. It will not be as organized or as well expressed as I would 
like because it is being dictated with no opportunity for review on my part. 
That in turn primarily because of the time that was spent reworking the nuclear 
monitoring study paper. It will be assumed in this memo that the reader has 
already read the prospectus for this study (Attachment 1). 


2. There were some assumptions that were made in the writing of the 
prospectus. One of them was that we should try to understand the impact of the 
review process from the very first time the reviews interact with the 
acquisition process. This is quite different from the approach taken in the 
Rand Study which used as a starting point the DSARC II that is the time at 
which the decision had already been made to begin full scale development (the 
Rand Study is supplied as Attachment 2 to this memo). Another assumption was 
that the effects of the program manager's perceptions on the impact of the 
review process were just as real as the direct impacts caused by a review. The 
Rand Study recognized the problems of acquiring and using "hard" data. In our 
case where we are starting much earlier in the process, it will be even more 
difficut to get hard quantifiable measures to use as a basis for analysis. 

This is due, in part, to the fact that in the early stages of system concept 
and evolution there is often not a great deal of documentation. 


3. Two efforts have been made to develop a better understanding of the - 
problem we're attempting to address by acquiring some background information. 
The first effort was to review the Rand Study which is included as Attachment 
2. A few points should be made about it. As stated earlier, the beginning 
point for their efforts was what was referred to as the DSARC II milestone. 
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SUBJECT: Notes on Proposal for Systems Acquisition Study 


The DSARC milestone II is the point at which approval has been given for 
full-scale development. For data sources they relied primarily on the 
quarterly selected acquisition reports (SARs) which provided the only easily 
retrievable, systematic record of acquisition program data extending over the 
period of interest. The study was limited to "major" defense systems or 
programs, a major system being one so designated by the Secretary of Defense. 
In practice, these are the systems that are expensive, are subject to DSARC 
review, and are reported on the SARs. At the time of the study, approximately 
50-60 systems had been reported on in this way, but the sample that Rand used 
was limited to about 30 systems. They excluded systems which had started 
full-scale development before 1969, a few systems for which data were 
incomplete or ambiguous, and Navy Ship Systems. Taking data from the SARs and | 
a few other sources, they attempted to compare the performance schedule and 
cost of programs in the 1970s. with those in the 1960s. In Chapter V they 
attempted to address the question, "Is it taking longer to acquire 
systems?--evidence from aircraft programs." The Rand study provides an 
interesting backdrop to what is proposed for PAO to do on systems acquisition, 
but it is not transferable in the approach or methodology for several reasons. 
The primary reasons are the starting points which they take as opposed to what 
we propose taking, and the second one related to the first is that we would 
have much less data available. Even with the SARs the problems that they had 
with data were considerable which they point out in the body of the report. In 
any event, there is no way of summarizing the significance of the Rand report 
as related to our study in this brief memo, but I would highly recommend 
reading it before initiating any real effort on our part. 


4. It was suggested by[ ___]that we attempt — 25X1 
to have a common model of the acquisition process, at Teast as perceived by 


PBO. It become immediately apparent that the PBO monitors do not have any kind 


< : 


of a commonality of model of the acqui n process in mind. The PBO monitors 
with whom I had a chance to speak were 25X4 
and to some degree,[_~—~+| «Briefly, there was no consensus as to whether 


the review process made things better or worse, as to whether there was any 
reasonable model of the acquisition process, whether there should be more oy 
less review or even as to whether the review process is interacting with the 
acquisition process in the right places. This is not to say that did not each 
have views but it is to say that there was no consensus upon which we could 
base any approach. I did not have an opportunity to speak witht _—___JIt 25x1 
would not serve any useful purpose in this memo for me to reiterate my 
impressions of their first comments on questions to which they had't had an © 
opportunity to give much thought as yet. Two things are apparent, first that 
the PBO monitors are well worth talking to on this subject and second, that you 
will not come away with any fundamental truths on which to hang your hat. 
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SUBJECT: Prospectus Review--Summary No. 1 (U) 


4, System Acquisition in the Intelligence Community: 


25X14 a-LSSCSCSSCidtopened the discussion by indicating that 
maybe some thought should be given to_including a GDIP and/or 
CCP system acquisition in the study. L___lalso noted that we 25x1 
need to define what we mean by a "major system acquisition." 


25X1 b. a to review the methodology which RAND 
used to do its study on DoD system acquisitions. [- also 


25X1 
emphasized that our approach needs to distinguish between 
gathering quantitative and anecdotal information. [~_l]also 25X11 
pointed out that PAO needs a conceptual model which describes 
the principal aspects of the system acquisition decision-making 
process. In this connection,[ Jwas urged to survey the PRO 25X1 
Program Monitors to identify candidate systems and to model the 
decision-making process as best he can. 


25X1 C. indicated that he might be reluctant to invest six 
man-months of effort in simply developing a guide that can be 
used to do a longer term study. This possibility should, 

; however, be explicitly considered in reviewing the prospectus. 

25x [also suggested the possibility of using a Community Working 
Group to help gather information for this study, develop 
"authoritative" assessments of the current system acquisition 
procedures, and make recommendations for reviewing existing 

25X14 procedures. Finally,[]suggested that we need “at least one 


good example" to use in any preliminary discussions that we have 
25X1 | i 


on this subject. Several ssibili 
brie? nerifone eee ext 


d. Pending actions are as- follows: 
(1) Initiate conversation with Program Monitors. 


(2) Explore the possibility of using a Community 
Working Group to address this subject. 


(3) Consider the possibility of a reduced effort 
which simply produces a guide for a longer-term study to be 
done by someone else or a Community Working Group. 


(4) Revise the prospectus to reflect PAO's latest 
thinking on the subject. (Suspense: Monday, 29 December). 
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5) Arrange forL________— i to meet 
25X1 with on this subject after the prospectus has 
been revised. 
cc :_AD/PAO 
25X1 
— 
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5 Dec 80 


TOPIC: Systems Acquisition in the Intelligence Community 


REASON: Systems acquisition in the intelligence community has evolved towards 
using a more extensive review process. This has affected both the costs and 
the time required for an initial operational capability. Understanding the 
nature and magnitude of those effects and whether they have improved or 
inhibited timely procurement could lead to procedural changes intended to 

‘ew decrease the time required to have new capabilities available to the 
intelligence community. 


OBJECTIVES: The objectives of this study would be to: 


9) Understand the effects that the more extensive review process of 
recent years has had on total system acquisition costs and time. 


a) In anticipation that those effects have both positive and negative 
connotations, attempt to assess a net impact. 


APPROACH: 


1. 


Background Studies - Rand Corporation did a study in 1979 on "Acquisition 
Policy Effectiveness: Department of Defense Experience in the 1970s." 


Work Breakdown - As the study is to encompass a historical review of 


representative major system acquisitions, it is tentatively proposed to 
Took at the following areas: 


a. The original U-2 development program as an early acquisition. 


b. The evolution of satellite acquisitions. 25X1 


Po 


The final selection of major systems acquisitions will be done with the 
programs in order to make it as representative as possible of the effects 
brought about by a changing review process. 


Methodology ~ After reviewing the RAND study, interviews with key people 
involved in the acquisition process of the various systems will be 
conducted. While cost and time Tine figures should be readily available 
from the historical record, the context for understanding the meaning 
behind the numbers must come from the memories and written records of the 
people involved. The study will rely heavily on descriptive methods with 
the role of mathematical analysis yet to be determined. 
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IMPACT: This study will focus on building capital for future decisions on 
changes, if any, which should be made in the review process. If this study can 
demonstrate that changes in the review process will contribute to more timely 
acquisitions of new capabilities, the eventual results could be better 
intelligence sooner. , 


SCHEDULE: 


I. Background reading and discussion with responsible 
representatives of the program offices to elicit their active 
nd participation in developing the study. 1 month. 


II. Interviews with people involved in specific acquisition 
programs. This will include various people in the intelligence 
community and contractors and will involve travel. The 
historical records will be reviewed along with other pertinent 
data. 4 months. — 


Meee 


III. Any remaining data acquisition, analysis and writing the report. 
2 months. 


-— 


STAFFING AND ORGANIZATION: 


25X1 Project leader: ESS 
25X1 Analyst: i if 


w LEVEL OF EFFORT: 


For the first 5 months, it will take 3/4 of the analyst's time. For the 
last 2 months, 1/2 of his time. 


2 
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Attachment to 
Systems Acquisition in the Intelligence Community Prospectus" 


It is recognized that the effect of the review process on system 
acquisition has many dimensions and perspectives from which it could be 
studied. These include, but are not limited to: 


0 The variations in impact on different NFI Programs. If the various 
Programs handle new systems acquisitions in different ways, the 


= effects that the review process have may vary considerably. 

fe) The relative significance of any impact on “major” systems, of which 
there are relatively few but each of which requires major resource 
allocations, and systems which involve less resources per project but 
which are more numerous. 

° Projects which have not gone to completion as well as those that 
have. Was the review process a significant factor in turning off the 
project? Was the decision primarily based on limited resources or 
did other factors emerge which caued the turn-off? 

a) Program perceived effects of the external review process that cause 
programs to change procedures prior to submitting proposed projects 
for review. 

(o) Insofar as reviews have affected projects, can we detect a pattern 

_ with respect to the impact of various review groups, such as the IC 
Staff, OMB, policy groups, or Congressional Committees? 

While such an all-encompassing study would, if completed, indeed expand 
our understanding of all of the implications of our present review process, 
such a study would require considerable resources from RMS and the Programs. 
The proposed study has taken a single cut through the many possible dimensions, 
with the intent of: 

fo) keeping the effort manageable 

ff) having the greatest potential impact for the effort devoted to the 
study 

) limiting the study to major systems so that a small number of 
projects would represent a significant sample. 

Ww 
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TOPIC: Systems Acquisition in the Intelligence Community 


REASON: Systems acquisition in the intelligence community has evolved towards 
requiring a more extensive review process. This has affected both the costs 
and the time required for an initial operational capability. Understanding the 
nature and magnitude of those effects could lead to procedural changes intended 
to improve the time required to have new capabilities available to the 
intelligence community. 


OBJECTIVES: The objectives of this study would be to: 


) Understand the effects that the more extensive review process of 
recent years has had on total system acquisition costs and time. 


6) In anticipation that those effects have both positive and negative 
connotations, attempt to assess an overall net impact or, as an 
alternative, estimate a net impact in specific cases. 


APPROACH: 


1. - Background Studies - Rand Corporation did a study in 1979 on "Acquisition 
Policy Effectiveness: Department of Defense Experience in the 1970s." 


2. Work Breakdown - As the study is to encompass a historical review of © 
representative major system acquisitions, it is tentatively proposed to 
look at the following areas: 


a. The original U-2 development program as an early acquisition. 


b. The evolution of satellite acquisitjons. 


3. Methodology - After reviewing the RAND study, interviews with key people 
involved in the acquisition process of the various systems will be 
conducted. While cost and time line figures should be readily available 
from the historical record, the context for understanding the meaning 
behind the numbers must come from the memories and written records of the 
people involved. The study will rely heavily on descriptive methods with 
the role of mathematical analysis yet to be determined. 


Approved For Release 2005/01/10 : CIA-RDP83M00171R000100050019-2 


Approved For Release 2005/01/10 : CIA-RDP83M00171R000100050019-2 


SCHEDULE: 
The study will occur in three phases: 


I. Background reading and discussion with responsible 
representatives of the program offices to elicit their active 
participation in developing the study. 1 month. 


II. Interviews with people involved in specific acquisition 
programs. This will include various people in the intelligence 
community and contractors and will involve travel. The 
historical records will be reviewed along with other pertinent 
data. 4 months. 


III. Any remaining data acquisition, analysis and writing the report. 
2 months. 


STAFFING AND ORGANIZATION: 

25x1 Project leader: — 

25X11 | Analyst: [_ 
LEVEL OF EFFORT: 


baad For the first 5 months, it will take 3/4 of the analyst's time. For the 
last 2 months, 1/2 of his time. 
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FROM: 
SUBJECT: 
REFERENCE: 


7 November 1980 


MEMORANDUM FOR: | | 


[______|Comments on the Systems Acquisition Prospectus 
D/PAO Memo, "PAO FY 1981 Study Plan" dtd 6 Nov 80 


1. This memo is an addendum to the revised prospectus on Systems 


Acquisition. 


fe) 


WARNING NOTICE 
INTELLIGENCE SOURCES 


AND METS i 


It follows the reference memo comments point-by-point. 


I agree that the emphasis is on the decision lag and its 
implications rather than actual procurement time. 


There are no representative success stories. The U-2 was chosen 
because it was a very early big system acquisition which helped 
set the tone for the early satellite acquisitions. — 
[sma be: "unique" technically and operationally but 
should give a good insight into a recent acquisition that went 
through a special decision cycle. I am certainly not hung up on 
these but think they might both offer special insights. I would 


also welcome suggested additions or alternatives. I believe it 
would be a mistake to restrict the effort to satellite systems. 


Certainly one would start with the Corona project. Other than 
that, about three others spread over the NRO history should 
suffice. I believe that the actual systems should be chosen in 
coordinaton with the NRO so as to best represent the evolution 
of the decision process. 


The prospectus was an abbreviated statement. The Phase II 
effort would not be limited to interviews but would be the time 
for the bulk of the effort. This would include interviews but 
also involve the review of historical records and any other 
pertinent data. I believe 4 months elapsed time is very 
realistic for this. 


n 
il 
or Release 2005/01/10 : PE GHEL oo171R00 100050019-2 


25X1 


25X1 


25X1 


Approved For Release ee SE ee 
mT a 


fe) The first 5 months would involve a concerted effort. The last 2 


months would have periods 


of dead time while the draft reports 


would be circulated for comments. 


2. Based on the above comments, the prospectus has minimal revisions. 
The prospectus now has an estimated level of effort added. 
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TOPIC: Systems Acquisition in the Intelligence Community 


REASON: Systems acquisition in the intelligence community has evolved towards 
requiring a more extensive review process. This has affected both the costs 
and the time required for an initial operational capability. Understanding the 
nature and magnitude of those effects could lead to procedural changes intended 
to improve the time required to have new capabilities available to the 
intelligence community. 


OBJECTIVES: The objectives of this study would be to: 


9) Understand the effects that the more extensive review process of 
recent years has had on total system acquisition costs and time. 


9) In anticipation that those effects have both positive and negative 
connotations, attempt to assess an overall net impact or, as an 
alternative, estimate a net impact in specific cases. 


APPROACH: 


1. Background Studies - Rand Corporation did a study in 1979 on "Acquisition 
Policy Effectiveness: Department of Defense Experience in the 1970s." 


2s Work Breakdown - As the study is to encompass a historical review of 
representative major system acquisitions, it is tentatively proposed to 
look at the following areas: 


a. The original U-2 development program as an early acquisition. 


b. The evolution of satellite acquisitions. 


3. Methodology - After reviewing the RAND study, interviews with key people 
involved in the acquisition process of the various systems will be 
conducted. While cost and time line figures should be readily available 
from the historical record, the context for understanding the meaning 
behind the numbers must come from the memories and written records of the 
people involved. The study will rely heavily on descriptive methods with 
the role of mathematical analysis yet to be determined. 
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SCHEDULE: 
The study will occur in three phases: 

I. Background reading and discussion with responsible 
representatives of the program offices to elicit their active 
participation in developing the study. 1 month. 

II. Interviews with people involved in specific acquisition 
programs. This will include various people in the intelligence 
community and contractors and will involve travel. 4 months. 


III. Any remaining data acquisition, analysis and writing the report. 
2 months. 


STAFFING AND ORGANIZATION: 
25X1 Project leader:[ | 
25X11 Analyst: [ 
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